High-Speed Distributed Data Handling for High-Energy and Nuclear Physics1

The advent (and promise) of shared, widely available, high-speed networks provides the potential for new approaches to the collection, organization, storage, and analysis of high-speed and high-volume data streams from on-line instruments. Such data streams originate from many types of on-line instruments and imaging systems, and are a “staple” of modern scientific, health care, and intelligence environments. We are defining and implementing an approach that provides for real-time analysis, cataloguing, and archiving of the data streams through the integration of data management techniques, a high-speed distributed application-oriented cache, distributed high performance applications, and transparent management of tertiary storage systems.